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A simplified analysis is given of a problem situation, previously treated in the literature, which 
pertains to the delay-minimizing allocation of servicing times among N incoming streams requiring 
"processing" of some kind by a single "server" (e.g., a time-shared computer). The original problem is 
generalized to permit different "weights" for the delays suffered by different streams. 
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1. Introduction 

A 1967 paper by Rangarajan and Oliver [l] 1 contains a formulation and analysis of the two 
problems described below, which pertain to the allocation of servicing times among N incoming 
streams requiring "processing" of some kind by a single "server." The server might for example 
be a switching point or a congestion point (e.g., a tunnel entrance) in a transport network, in which 
case "processing" an item (vehicle) simply means letting it through. Or, the server might be a 
computer handling reservations from several ticket offices, or exercising real-time control over 
vehicle movements on several network links, or performing some other tasks on a time-shared basis. 

The streams are treated as continuous flows. During each service cycle, of duration 7\ the 
server handles stream 1 for time G\, switches (with associated known switch-over or "dead" time) 
to handle stream 2 for time G 2 , etc. The arrivals in each stream are assumed nonrandom, with a 
known uniform rate (possibly different for different streams). The server's processing rate, when 
serving a particular stream, is also assumed nonrandom and constant (possibly different for different 
streams). Each G\ is constrained to be at least large enough so that no queue remains in the tth 
stream when one of that stream's service periods ends. 

The two problems formulated and analyzed are these: 

PROBLEM 1: For given cycle time 7\ what allocation d, G 2 , . . ., Cv of service times among 
the various streams is optimal, in the sense of minimizing total waiting time per cycle? 

PROBLEM 2: What value of the cycle time T will minimize average waiting time? 

Subsequently Horn [2] showed that the more general case, in which all streams are served 
equally often (possibly more than once) per cycle, can be reduced to PROBLEM 1. This provides 
additional reason for offering an alternative analysis, which is more self-contained and (at least to 
the writer) simpler than that of reference [1]. In addition, a mild generalization will be introduced 
by permitting the penalties for delay to be different for different streams. 
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2. Formulation 

The data for PROBLEM 1 are 

T= cycle time, 

N= number of streams, 

at = arrival rate for ith stream, 

si= service rate limit when processing ith stream (si > at) , 

di = dead time in switching from ith stream to next one, 

Pi = penalty factor for delays to ith stream. 

Note that our (a*, s,, di) are the (A*, /m, Ti) of reference [1] , which in effect assumes all pi= 1. 

Under the assumption of first-in-first-out service within each stream, the waiting time per cycle 
for the ith stream is found as in reference [1] to be 

W i [T,G i } = {a i (T-G i y+a]{T-G i yi{si-a i )}l2 

= aiSi(T-Gi)V2(si-ai). (1) 

(The factor 1/2 was omitted from the analogous equation in reference [1]; also our (1) differs from 
that formula by a factor T because we work with total rather than time-averaged delay.) Thus the 
function to be minimized is 

W^^Pia&iiT-GiY^Si-ai). (2) 

1 

The condition, that each stream have its queue disappear before its service period ends, is 
expressed by 

Gi(si-ai) ^ (T—Gi)(U or equivalently GjSi^Tcii, 

which is equivalent to 

(T-Gi)si^T(si-ai). (3) 

The remaining constraint on the G;'s is the obvious identity which can be expressed, in terms of 
total service time and total dead time 

G = ^d and D = ^d u 
i i 

in the form 

G + D=T. (4) 

We simplify by introducing the new variables 

Xi=(T-Gi)IT, 
and also 

W=2W°IT Z (5) 

as the new minimand, equivalent to the previous one since T is fixed for PROBLEM 1. Furthermore, 
let 

bi= (si-ai)lsi >0, 

d = piOilbi = Picusil (si — di) > 0, 
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qt= lla = bilpi04> 0, 
B = N-1+(DIT). 

Then from (2) and (5), we see that PROBLEM 1 requires the minimization of 



N 



W(T) = W=^ax\ (6) 

1 

subject to the conditions (3), which are equivalent to 

O^xt^bu (7) 

and to condition (4), which is equivalent to 

j?-x; = B. (8) 

1 

From (7) and (8) we obtain the condition 

B^b u (9) 

1 

which is both necessary and sufficient for the consistency of the constraints, and is assumed to 
hold in what follows. 

3. Solution of PROBLEM 1 

Since the problem requires minimizing a continuous strictly convex function over the closed 
bounded subset of jc-space defined by (7) and (8), there must exist a unique relative minimum which 
is in fact the unique absolute minimum. Hence we need only derive enough necessary conditions, 
for a local minimum, to single out just one point in .%-space. 

The streams will be numbered (in analogy with p. 76 of ref. [1J), so that 

P\ai = bid ^ p 2 a2 = b 2 C2 ** . . . ^ p\a N =b.\c.\ > 0. (10) 

Observe first that at a local minimum, 

CiXi < qxj implies Xj = or x% = &*, 

for otherwise we could further decrease the objective function (6) without violating the constraints 
(7) and (8), by decreasing Xj and increasing Xi by the same sufficiently small positive quantity. 
Since Xj=0 in this situation would lead to a contradiction of the condition xt ^ 0, we in fact have 

CiXi < qxj implies Xi = b{. (11) 

In analogy with eq (4a) of reference [1], let r be the smallest index for which x r = b r in the locally 
optimal solution under consideration. (If a* < bt for i=l, 2, . . ., TV, then take r=N+ 1.) We next 
show that 

xt = bi if i^r, (12) 
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i.e., that streams 1 through r— 1 are precisely those served longer than needed to eliminate their 
queues. That xi < bi for i < r, follows from the definition of r. To rule out the possibility that x\ < bi 
for some i > r, note that biQ ^ 6 r c r , so that 

QXi < biQ ^ b r Cr = C r Xr, 

which by (11) implies x% — bi, a contradiction. 

In particular, the solution is fully determined (each xi = bi) if r = 1, which by (12) and (9) can 

N N 

occur iff fB=^ bi. Thus in what follows we temporarily assume B < ^ bi, so that r > 1. 
i i 

Next, (11) and (12) imply the existence of some K > such that 

CiXi = K for all i < r, 
or equivalently 

xt = qiK for all i < r. (13) 

It follows from (8), (12), and (13) that 

B = K% qi + £ b u 

1 r 

implying 

*=^-r — • (14) 

1 
From (13) and the fact that x r -i < b r -u we have 

K < b r -iC r -l=Pr-ia r -i. (15) 

If r^ N, then it follows from x r -i < b r -i and (11) . . . with i = r-l and j=r . . . that 

K= Cr-iKqr-i^ Cr-iXr-i ^ c r x r = c r b r (r ^ N) . (16) 

We next dispose of the case r=7V+ 1. By (8) and (13), if r =7V-h 1 then 

**=#- (all.), 



K = 



2* 

i 

B 



(17) 



Using (15), we see from (18) that r = N + 1 implies 

B<b N c N ^qi. (19) 

Conversely if r < N+l, then (14) and (16) would both hold, yielding 
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fl=X2«l + 2 bi & brCr^qi + f^ (b iCi ) qi > bsC N ^ q U 



1 



contradicting (19). So (19) is a necessary and sufficient condition for r = N + 1. 
Suppose now that 1 < r < N+ 1. Using (14), (15), and (16), we have 

r-l N r-1 N 

b r Cr 2 qi + ^bi^B < br-lCr-l ^ <7* + 2 ** 
1 r 1 r 

as the test for determining r. With r known (1 < r < 7V + 1), the optimal solution is given by (12), 
(13), and (14). Since b r -\C r -\qr-\ — b r -u lne test can be rewritten 

Br^B<B r -u (20) 

in terms of the quantities 

B*=6*c*2> + 5>. (21) 

1 k 

With the convention B/v+i — 0, the test remains valid when r=/V+l, according to the discussion 
surrounding (19). And with the convention B =ao , it remains valid for r= 1 as well (necessarily 
with B = B\). The test is satisfied for at most one value of r since Z?/v+i < Bn and for 1 < k < N+ 1, 

A-l 

B k - X -B k = (6/c-iC/c-i - fcfcCjfe) ^ g,- ^ 0; 

it is satisfied for at least one value or r since Bn+i < B ^ B\. 

We conclude this section by summarizing the solution process, in terms of the problem data 
(assuming the ordering (10)): 

Step 1: Calculate the total dead time per cycle, D. 

Step2: Calculate B = N-1 + (D/T). 

Step 3: Calculate the quantities bi = (si — ai)lsi and their sumfii. 

Step 4: If B>Bi, then stop; the problem is infeasible. If B = B U the optimal solution is 
Gi— Tail Si for all i. If B < Si, continue. 

Step 5: Beginning with Bi and with Q o = 0, calculate quantities Q u B 2 , Qi, B 3 , etc. by the 
formulas 

b k 
Qk- 



Pkdk 
Qk = Qk-\ + qk, 

B k = Bk-l — (Pk-\dk-\— Pkdk)Qk-\- 



Stop as soon as B k ^ B is attained, set r= k, and go to Step 6. If B < Bn is encountered, the optimal 
solution is 

Gi=T-(TBIQ N ) Qi 
for all i. 

Step 6: Calculate 



H»') 
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The optimal solution is given by 



Recall the relation 
between B and 7 1 , which yields 



Gi=T-TK qi (»<r), 

Gi=Tai/si (i^r). 

4. Solution of Problem 2 

D/T=B-N+l (22) 

dBldT=-D/r-. (23) 



The decreasing sequence {Ba}| denned by (21) yields, through (22), an increasing sequence {Tk}* 
of break-points in "T-space." The feasibility condition B ^ B\ is equivalent to T^Ti, and the 
interval Bk^B < B k -i on which r= k corresponds to the interval Tk-i <T^T k . 

Let W mm (T) be the minimized value of W(T) , as determined in section 3. Then by (5), we have 
the expression 

W« min (T) = PW min (T)l2 

for the minimum delay per cycle, so that 

V°(T) = TW min (T) (24) 

is twice the minimized time-averaged delay per cycle. Thus our objective in PROBLEM 2 is to 
choose T, subject to T ^ 7\, so as to minimize V°(T). 

First consider the behavior of V°(T) on the interval (7V,°°) corresponding to the range B < Bm. 
By (17) and (6), 

W min (T) = (BIQ N )^c iq 2 h 



so that (24) yields 
Using (23), we have 

and since 



V° (T) = (B*T) X (pos. const.). (25) 

(d/dT) (B 2 T)=B* + 2BT(dB/dT) = B 2 -2B (D/T) 

= B[2(N-l)-B]>B[2(N-l))-B N ], 



B N ^B 1 =%bi^N<2(N-l) 



(assuming of course that N > 1), it follows that (7#, °°) is an interval on which V°(T) is increasing, 
hence not an interval on which the minimum of V° (T) can occur. 

Next, consider the behavior of V°(T) on the interval {T r -\, T r ). Minimizing V°(T) over this 
interval is equivalent to minimizing 

Vr(T) = V0(T)'''2 qt- (26) 

1 

Using (12) and (13) to substitute the optimal solution to PROBLEM 1 into (6), we obtain 

1 r 
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i /• 

which by (14) can be rewritten 

^mCO = (fi - J 6i ) 2 (2 ^i)" 1 + £ cAf. (27) 

It follows from (24) and (26) that 

This formula, (22) and (23) yield 

dV r ldT = (B - I fc) (2^ - 2 - I 6,- - fi) + (| q6«) ( 2 ©), (28) 

d 2 V r ldT 2 = 2D 2 IT 3 > 0. (29) 

Suppose in particular that r ^ 3. It will be shown that 

dF r /dr ^ (right derivative at r= T r -i), (30) 

which by (29) implies that (7V-i, F r ) is an interval on which V r (T) and hence V°(T) is increasing, 
hence not an interval on which the minimum of V°(T) can occur. 

By (21) and (28), the expression in (30) whose sign is to be determined is 

(Br-, ~ I bi) (2N-2-2 b, - B r -!) + (| Cbf) (| «) 

This has the same sign as 

Dr-l = 2N-2~2^bi- b r -lC r -l £ 9*+ (^r-lCr-O" 1 £ **?- 



Since 

r-l r-1 r-1 

br-lCr-l X ^ '^ 2 biCiqi= ]T **> 
1 1 1 

we have 

D r - l ^2N-2-2J^b i -J j b i + (br-icr-i)- 1 2 c ' 6 r 

r 1 r 

Because each 6* < 1, the two subtracted terms in the right-hand side total less than 

2(N-r+l)+ (r-l)=2JV-rf 1, 

which is no greater than 2N — 2 for r ^ 3. Thus D r -\ > for r ^ 3, verifying (30). 
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We have shown that the minimum of V°(T) over (7\, oo) is given by its minimum over [T u 
T 2 ]. That is, as noted in reference [1], in an optimal solution one has r= 1 or r= 2, so that for all 
but at most one stream one has Gi/T = Oi/su i.e., all "slack time" (if there is any) is concentrated 
in the period allotted to a single stream. 

The minimum over [7\, T 2 ] is determined as follows. Using (27) with r= 1 and r = 2, it is readily 
verified that W min (T) is right-hand continuous at 7\. Thus the problem is equivalent to that of 
minimizing V 2 (T) over [7\, T 2 ]. 

By (29), the minimum will occur at T\ if (30) applies there, and by (28) this condition reads 

b x (2N -2-^-2 ^ 61) + Qi 2 **f ^ °> 

> 2 ' 2 

or equivalently 

N 

p 1 a l (2N-2- 2Bj + 6 X ) + 2 Pi<nbi ^ 0- (31) 

2 

If (31) does not hold, then dV 2 /dT = occurs at a unique value T* 9 where T* > 7\, and the 
optimum occurs at T* or T 2 according as 7 1 * ^ T 2 or 7 1 * > T 2 . Specifically, from (28) and (22) we 
have 



DIT* + N-\ - J fc) (iV-l-D/2*-2 *«) + (2 c ; 6f) 9l = 0, 
or equivalently 

(#- 1 - 2 k) 2 - (o/r ) 2 +(2 «4j) 9l = 0, 

yielding 

r/ iV \2 v 1-1/2 

r = D j^-l-2 6.) +9.2^?} • (32) 

The solution process for PROBLEM 2 can be summarized as follows, assuming the ordering 
(10): 

Step 1: Calculate the total dead time per cycle, D. 

Step 2: Calculate the quantities b t = {si — Oi)lsu their sum B u and the quantity 

B 2 = B\ — (bi— p 2 a 2 bilp\CLi ) • 

If B\ ^ N — 1, stop; the system is infeasible. 

Step 3: If (31) holds, set 7 1 =D/[fi 1 - (JV-1)] and Gi=Tail Si for aU i. 
Step 4: Otherwise, calculate T 2 = D/[B 2 — (TV— 1)] and 



7* = D |#_ 1 _ fll + 6l )2+ ( bl i Piai ) 2 pmbX 

if r*>r 2 , setr=r 2 and 

G 1 =T 2 (l+Bi-B 2 -b 1 ). 

if r* ^ r 2 , set r= r* and 

G 1 = T*[B l -b l -(N-2)]-D. 

In both cases, set Gi= Tajsi for i > 1. 
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